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Abstract: Astronomy is entering a new era of discovery, coincident with the establishment of new 
facilities for observation and simulation that will routinely generate petabytes of data. While an 
increasing reliance on automated data analysis is anticipated, a critical role will remain for visualization- 
based knowledge discovery. We have investigated scientific visualization applications in astronomy 
through an examination of the literature published during the last two decades. We identify the 
two most active fields for progress - visualization of large- A*' particle data and spectral data cubes - 
discuss open areas of research, and introduce a mapping between astronomical sources of data and 
data representations used in general purpose visualization tools. We discuss contributions using high 
performance computing architectures (e.g: distributed processing and CPUs), collaborative astronomy 
visualization, the use of workflow systems to store metadata about visualization parameters, and the 
use of advanced interaction devices. We examine a number of issues that may be limiting the spread of 
scientific visualization research in astronomy and identify six grand challenges for scientific visualization 
research in the Petascale Astronomy Era. 
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1 Introduct ion derstanding, interpreting, and verifying the outcome 

of automated approaches requires human intervention. 
Astronomy is a data-intensive science. Petab yte^ of T his is most easily achieved by simply looking at the 
observational data is already in stored archives l|Brunner et adib -ta: the human visual system has powerful pattern 

l2002l : ISzalav and Gravl200ll l. even before faciliti es such recognition capabilities that computers are far from 

as the Atacama Large Millimeter Array [ALMA: [Brown et alt eing able to replicate. 
(120041')] ■ the Large Synoptic Survey Telescope [LSST; 
llvezic et al.l (120081)1 . L OFAR (gottgcrine 2003), SkyMap 
per (|Keneretld.ll2007l ). the Australian Square Kilomc 



tre Array Pathfinder fASKAP: Dohnston et al. (2008)1 . the 
Karoo Array Telescope [MeerKAT: ([Booth et al.l2009l )]. 
and ultimately the Square Kilometre Array itself, reach 
full operational st atus. Cosrnolog i cal simulations with 
10^° particles [e.g. ISpringell (|2005f ): lKlvpin eTaP ([2010l )] 
are also producing many-terabyte datasets, and the 
highest resolution simulations codes executed on the 
next generation of petaflop/s supercomputers will re- 
sult in further petabytes of data. The Petascale As- 
tronomy Era is a natural outcome of current and future 
major observatories and supercomputer facilities. 

Astronomy sits alongside fields such as high-energy 
physics and bioinformatics in terms of the data vol- 
umes that are available to its practitioners. Such data 
volumes pose significant challenges for data analysis, 
data storage and access, leading to the development of 
a four th data-inte nsive (or eScience) paradigm for sci- 
ence ([Szalav and Grav 2006; Boll ot al. 2009). Much 
work will be required to find effective solutions for 
knowledge discovery in the Petascale Astronomy Era, 
with a likely emp hasis on automated analysis and data 
mmmg proce sses (iBa ll and Brunneil[200alBorndl2009l : 
iPesenson et al. 2010). However, a critical step in un- 



Astronomy has a long history in the use of dia- 
grams, maps and graphfl to explain concepts, aid un- 
derstanding, present results, and to engage the public. 
However, there is more to visualization than just mak- 
ing pretty pictures. Data visualization is a fundamen- 
tal, enabling technology for knowledge discovery, and 
an important research field in its own right. 

The broader field of astronomy visualization en- 
compasses topics such as optical and radio imaging, 
presentation of simulation results, multi-dimensional 
exploration of catalogues, and public outreach visu- 
als. Aspects of visualization are utilized in the var- 
ious stages of astronomical research - from the plan- 
ning stage, through the observing process or running 
of a simulation, quality control, qualitative knowledge 
discovery and quantitative analysis[3 Indeed, much 
of astronomy deals with the process of making and 
displaying two-dimensional (2D) images (e.g. from 
CCDs) or graphs which are suitable for publication 
in books, jo urnals, conference presentations and in ed- 
ucation [see [Fluke et al. (2 009 ) for alternatives]. 

An important sub-field of visualization is scientific 
visualization: the process of turning (numerical) data 
with dimensionality A'' > 3, usually with an inher- 



^1 petabyte = 10^^ bytes 



^See iFunkhoused lll936l ) for an account of the earliest 
extant astronomical graph. 

^ These are distinct phases - see lDiorgovskil l l 20051) . 
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ent geometrical structure, into images that c an be in- 
spected by ey e. At its conception in the 1980s (^Mc Cormick 
[l987 : Frenkeilll988l : lD"eFanti et aLl fToSQ). scientific vi- 
suahzation was envisaged as an interactive process, 
with an emphasis on understanding and analysis of 
data (including qualitative, comparative and quanti- 
tative stages), not just presentation (Wright 2005). 
Research in this field includes techniques for display- 
ing data (e.g. through the use of surface rendering, 
volume rendering, streamlines, etc.), efficient imple- 
mentations of display algorithms for increasingly com- 
plex data and data structures (including both data di- 
mensionality and dataset size) while retaining inter- 
activity, and effective use of high-performance com- 
puting for tasks such as parallel rendering and com- 
putational steering (where interaction with a simula- 
tion occurs during processing, and helps to drive the 
direction of the next stage of processing). We re- 
fer the interested reader to the general introductions 
byff allaglicr (1995), Johnson and Hansen (2004), and 
ISchroeder et al.l (|2006ll . 

There is a very subtle distinction between scientific 
visualization and the closely-re lated field of informa- 
tion visualization (|SDencell200ir i. The latter deals with 
presentation and understanding of multi-dimensional 
data, where the search for relationships between data 
points is the motivation for investigation. The fol- 
lowing example attempts to highlight the difference: 
a map of the locations of normal elliptical galaxies 
with a colour scheme or symbols relating to mean sur- 
face brightness, effective surface brightness and cen- 
tral velocity disperson (so that the emphasis is on 
the spatial arrangment) is a scientific visualization; 
a three-dimensional plot of these last three quanti- 
tites d emonstrating how they form the fundamental 
plane (|Diorgovski and David Il987l ) is an information 
visualization. Similarly a three-dimensional (3D) plot 
of the {x, y, z) locations of particles from an TV-body 
simulation, where no colour coding is used to present 
additional numerical properties is information visual- 
ization (essentially a 3D scatter plot), but colouring 
particles by local density or temperature, or the use 
of a surface or volume rendering technique to identify 
large-scale structures, is scientific visualization. We 
make use of this distinction in order to help identify 
research work that is relevant for our overview, and 
for brevity use "visualization" hereafter to mean three- 
dimensional scientific visualization. 

As a multidisciplinary field, scientific visualization 
has been used with great success in medical imaging, 
molecular modelling, engineering (e.g. computational 
fluid dynamics), architecture, and astronomy. Scien- 
tific visualization of astronomical data includes both 
observational data generated over a variety of wave- 
lengths (optical, radio. X-ray, etc.) or from computer 
simulations. Visualization of observational data poses 
some specific challenges in terms of the data volume, 
dynamic range, (often low) signal-to-noise ratio, in- 
complete or sparse sampling, and astronomy-specific 
coordinate systems. For simulations, challenges in- 
clude the number of particles, mesh resolution, and 
range of length and time scales. While any one of 
these issues is not unique to astronomy, taken as a 



who le, effective astrophysical visualization requires its 
etoaki unique solutions. 

One of the first systematic astronomy visualiza- 
tion trials was undertaken by Gitta Domik, Kristina 

Mickus-Micoli, and collaborators at the Univer s ity of 

Colorado Mickus ct al. ( 1990allbh: lDomikl (|l992l '): lDomik and Micku 
(119921 '): iBrugel et al.l (11993 ')]. They developed a proto- 
type application named the Scientific Toolkit for As- 
trophysical Research (STAR) using IDL on top of X- 
Windows. Their main goals were to offer visualization 
tools that were driven by the needs of astronomers, 
and that would integrate with existing data analysis 
tools, star's main functionality included display of 
one and two-dimensional datasets, perspective projec- 
tion, pseudo-colouring, interactive colour coding tech- 
niques, volumetric data displays, and data slicing. STAR 
was introduced as a prototype to prove the feasibility 
of the user interface, and visualization techniques pro- 
pos ed in t h eir re port. 

iNorrid (11994 ) presented a blueprint for visualiza- 
tion research in astronomy, highlighting the suitability 
of 3D visualization for providing an intuitive under- 
standing that was missing when using 2D approaches 
(e.g. data slicing, where individual channels are ex- 
amined separately or played back as movie, requiring 
the viewer to remember what was seen in earlier chan- 
nels). 'Visualization techniques could enable features 
of the data to be seen that would otherwise have re- 
mained unnoticed, such as low signal-t o-noise struc- 
tures extending over multiple channels. iNorrid (|l994l ') 
noted the importance of visualization in communicat- 
ing results qualitatively, but identified quantitative vi- 
sualization as the missing ingredient that would allow 
true interactive hypothesis testing - an essential part 
of the scientific process. While still relevant today, 
several key aspects - most notably a wider uptake of 
3D visualization by astronomers - have yet to be fully 
realised. 



1.1 Scope and Purpose 

We consider the development, advancement and ap- 
plication of scientific visualization techniques in as- 
tronomy over the last two decades - coincident with 
the lifetime of scientific visualization as a field of in- 
quiry in its own right. To our knowledge, there have 
been no previous attempts to examine the status of 
scientific visualization in astronomy. The Masters the- 
sis by Halo mino (2003,) discusses visualization strate- 
gies for several numerical datasets from astronomi- 
cal simulations; iLeech and Jennes3 (120051 ) surveyed vi- 
suali zation software available for radio and sub-mm 
data; iDubinskil (120081 ) provided an introduction to par- 
ticle visualization as a companion to a brief h istory of 
A''-body methods; iKapferer a nd Riser ('2008^ consid- 
ered software and hardware visualiza tion requirements 
for numerical simulations; iLi et al.l (|200a ') described 
strategies for deal ing with multiwavelength data; and 
iFluke et al.l (|2009l ) summarised some basic elements of 
cosmological visualization for observational and simu- 
lation data. 

It is not our intent to provide a comprehensive ac- 
count of all research outcomes that have made use of 
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scient ifi c visualization tools or approaches [see lBrodbeck et aii id volume rendering^ Figure [T] shows how the same 
(| 19981 ), iHultauist et"al] (|2003l '). or the gr owing scien- 
tific o u tput from the A s troMe d pro ject. iBorkin et aLl 
(|2008l l ■ iGoodman" et alJ (|2009l ). and lArce et al .1 (|2010l ) 
for representative examples], but to investigate how 
scientific visualization in astronomy has advanced over 
the last two decades. In particular, we do not con- 
sider geographical-style 3D visualization from plane- 
tary m issions, or data from sola r physics [s ec Ireland and. 
(|2009l ). and articles therein, or I Aschwanden (2010. ) for 
a complementary review of the latter field]. We aim 
to provide an overview for researchers who wish to 
understand the state of scientific visualization in as- 
tronomy, with an emphasis on simulation and spectral 
cube data, aiming to motivate future work in this field. 
We assert that many current astronomy visualization 
approaches and applications are incompatible with the 
Petascale Astronomy Era, and much work is required 
to ensure that astronomers have the tools they need for 
knowledge discovery over the next decade and beyond. 

The remainder of this paper is set out as follows. 
In section [2] we present an overview of progress in sci- 
entific visualization in astronomy, from projects in the 
early 1990s until the present. We pay special atten- 
tion to two important classes of data: large- A'' particle 
systems (section 12. 3p . and spectral data cubes (sec- 
tion 12. 4p . We consider other research areas including 
distributed (section 12. 5p and collaborative visualiza- 
tion (section I2.6|l , image display (section I2.7|l , work- 
flow (section l2.8|l . and public outreach visuals (section 
12. 9|) . In section 131 we demonstrate how the nature of 
astronomical data impacts on the choice of visualiza- 
tion software, highlighting some of the advantages and 
disadvantages of using general visualization packages 
instead of custom astronomy code. In section U) we 
discuss some of the challenges that astrophysical vi- 
sualization must overcome in order to be useful and 
usable, and identify six grand challenges for scientific 
visualization research in the Petascale Astronomy Era. 
Finally, we present our concluding remarks in section 

m 

For a article on visualization, it may seem surpris- 
ing that so few images have been included. Our pref- 
erence is for the reader to view the original, published 
versions, appearing as their author(s) intended, rather 
than attempting to replicate them here. Any omission 
of significant work or software related to scientific vi- 
sualization in astronomy is wholly the responsibility of 
the authors. 



2 Scientific Visualization in As- 
tronomy 

2.1 Visualization Techniques 

As a starting point to exploring advancements in scien- 
tific visualization in astronomy, we introduce the most 
common techniques for presenting three-dimensional 
scalar data in astronomy: points, splats, isosurfaces 



dataset, in this case a single snapshot from a cosmolog- 
ical simulation, appears when rendered using the four 
techniques. 

Plotting points (top left) as fixed width pixels is of- 
ten the most straightforward representation, however, 
this approach is limited by the available resolution (or 
pix el density) of the display. Splatting (top right) uses 
Youmnfcl l textures, often with a Gaussian intensity profile, 
to replace point-like objects. Splats are billboards, i.e. 
they always point towards the virtual camera regard- 
less of the orientation of the scene, and scale better 
with distance than pixels. Combining splats on the 
graphics card gives an effect like volume-rendering, but 
without the calculation overhead of ray-tracing. 

An isosurface (bottom left) or isodensity surface 
is a three-dimensional equivalent of contouring. Com- 
mon methods for calcula ting an isosurface from a dataset 

include marching cubes (iLore nsen and Cline'l987l; lMontani et al.l 
[i994), marching tetrahedra (Bloomonthal 1994) , mul- 
tiresolution isosurface extraction ( Gcrstncr and Paiarolal 
[2000), and surface wavefront propagation ( Woocl^tld] 
[2000). Isosurfaces are usually used to search for cor- 
relation between different scalar variables, but are less 
useful to give a global picture of the dataset. Volume 
rendering (bottom right) attempts to provide a global 
view of the dataset, particularly useful to render both 
the external surfaces and the interior 3D structures 
with the ability to display weak or fuzzy surfaces. Vol- 
ume rendering can be performed using ray-tracing or 
using the graphics card to comb ine a series o f (semi- 
)transparent texture maps [e.g. ICabral et al] l|l994) . 
this approach was used for Figure [T]. 

2.2 The Nature of Astronomical Data 

The nature of data has an impact on the choice of 
visualization technique, and hence so ftware. One w ay 
to look at astronomical data (Brunn er et al.l [20021 ) is 
to consider the origin or physical source: 

• Imaging data: two-dimensional within a narrow 
wavelength range at a particular epoch. 

• Catalogues: secondary parameters determined 
from processing of image data (coordinates, fiuxes, 
sizes, etc). 

• Spectroscopic data and associated products: this 
includes one-dimensional spectra and 3D spec- 
tral data cubes, data on distances obtained from 
redshifts, chemical composition of sources, etc. 

• Studies in the time domain: including observa- 
tions of moving objects, variable and transient 
sources which require multiple observations at 
different epochs, or synoptic surveys. 

• Numerical simulations from theory: which can 
include properties such as spatial position, ve- 
locity, mass, density, temperature, and particle 



*We found few papers that explicitly discussed the use 
of streamlines as a visualization technique. Outside of solar 
astronomy, these are more commonly used to understand 
flows in, e.g. computational fluid design or geophysics vi- 
sualizations. 
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Figure 1: Four common visualization methods applied to a cosmological A^-body dataset. Scattered point 
data (top left); Gaussian "splats", using transparent-mode texture blending (top right); three represen- 
tative isosurface levels with density increasing from red-orange-yellow (bottom left); and texture-based 
volume rendering with "heat" colour map increasing from black through red and yellow to white (bot- 
tom right). Data courtesy Madhura Killedar (University of Sydney). Visualization was performed using 
S2PL0T. 
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Figure 2: The four standard data representations used in scientific visualization. Scattered point data 
(top left); structured grid (top right); unstructured grid (bottom left); and adaptive/multi-resolution grid 
(bottom right). Visualization was performed using S2PL0T. Note that the bounding box surrounding 
the unstructured grid is for reference only. 
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type. These properties may also be presented 
with an exphcit time dependence through the 
use of "snapshot" outputs. 

An alternative classification [see iGallagheil l|l995l )] is 
based on how the data is representated programmati- 
cally, i.e. how it is stored and organized in memory or 
on disk: 

• Scattered points: data is comprised of a set of 
point locations {x, y, z) and associated data at- 
tributes (e.g. density, pressure, and tempera- 
ture) . 

• Structured grid: data values are specified on a 
regular three-dimensional grid, with grid cells 
aligned with the Cartesian axes. 

• Unstructured grid: data values are specified on 
corners of a 2D/3D shape element with an ex- 
plicitly defined connectivity. 

• Adaptive grid: data values are specified on a 
multi-resolution structured grid. A coarse grid is 
used to cover the entire computational domain 
combined with superimposed sub-grids to pro- 
vide higher resolution for regions of interest (e.g. 
where particle density is highest). 

Figure [2] demonstrates each of these representations. 
This second classification is more familiar to praction- 
ers of scientific data visualization, and is one that helps 
guide the choice of visualization techniques in a way 
that is somewhat independent of a particular scientific 
domain. Figure [3] demonstrates, in broad terms, how 
the astronomically-motivated data categories can be 
mapped into the data representation schema. Unstructured- 
grids are rarely used in astronomy because they are 
usually generated from finite element analysis or do- 
main decomposition methods, which are not widely 
used in astronomy [see SorinKcl (2010) for an example 
of unstructured grid usage]. 

With regard to 3D scientific visualization, we are 
primarily interested in spectroscopic, time domain-data, 
and numerical simulations, but there may be a need to 
overlay images (e.g. image slicing), or secondary cat- 
alogue data (e.g. for comparisons between multiwave- 
length data). Based on the astronomical data category, 
the majority of visualization papers that we identified 
related to either A'^-body and other large-scale particle 
simulations or spectral data cubes. We now summa- 
rize the main developments in each of these two areas. 
In particular, we focus on the implementation trends, 
as this provides a useful starting point for future work 
in this field, and occurences of the visualization tech- 
niques outlined in Section [2.11 We do not attempt to 
provide specific technical details of each visualization 
solution, as some approaches are now out-dated due 
to improvements in graphics hardware - most notably 
through the appearance of low-cost, massively parallel 
graphics procesing units (CPUs). 

2.3 Large-A^ Particle Simulations 

For a science where direct experimentation is challeng- 
ing, numerical simulations provide astronomers with 
a link between observations and theory. Continued 



growth in processing power, new architectures and im- 
proved algorithms, have all enabled simulations to in- 
crease in resolution and accuracy. Most astronomy 
simulations use of one of three main data representa- 
tions (see Figure [31): 



1. Multi-dimens ional scattered data 
GADGET-2 (|Springell |2005| ) 



such as the 
file format. Here, 



each data point is characterised by a set of spa- 
tial coordinates, with additional scalar and vec- 
tor properties. This can be mapped to a regular 
scattered data visualization problem. 

2. 3D/2D structured grid: where the point-data is 
distributed over a regularly-spaced mesh with 
a predefined resolution us ing smoothing tech- 
nique s such as cloud-in-cell ijHocknev and EastwoodI 
Il988l ). This data representation may cause a 
loss in fine details on scales below the mesh-size 
(|Hopf et alj|2004l ). 

3. Adaptive/multi-resolution grid: where the point- 
data is distributed over an adaptive mesh with 
a variable resolution. This is often the best data 
representation to cover a wide range of spatial 
and tem poral domain with a minimal data size 
(|Kahler e t al. 2002). However, implementation 
and handling of boundary conditions between 
scales can be challenging. 

Table [T] summarizes contributions dedicated to the 
A-particle visualization problem with a classification 
based on the dataset representation type, the imple- 
mentation trend, and the main visua Uzation technique s 

used. It is noteworthy here that iPalomind ll2003l). 

[Staff et alJ(|2004l ). lBiddiscombe et all (|2007l ). and lKapferer and Ris( 
(12008") presented the usage of vector plots as one of 
the visualization techniques. Although it is not com- 
monly used to represent vector quantities from sim- 
ulations in astronomy, vector visualization is a very 
useful technique as has been demonstrated in other 
fields, especially computational fiuid dynamics. How- 
ever, interpreting the physical meaning of vector fields 
is a higher-level cognitive task compared to identify- 
ing structures through the use of surface or volume 
rendering. 

Visualizing A^-particle data is a problem common 
to many scientific fields (e.g. point-based surface rep- 
resentations for 3D geometry processing 0) , and this 
has been an area for active research over the last two 
decades. Such datasets are most ammenable to the use 
of general purpose scientific visualization tools/libraries, 
although there is still a tendency for astronomers to 
develop their own solutions. In the astronomical lit- 
erature, we identify three main approaches to imple- 
mentation. 

The first approach is to use an existing general pur- 
pose tool as-is (Palomino 200^: iNavratil et al ] l2007l : 
iKapferer and Riser, 2008, ). however a data preprocess- 
ing step is usually required to convert the data into a 
suitable representation before the visualization is per- 
formed. [Palomino (2003) used IDL to visualize 2D/3D 
numerical simulations of magneto-hydrodynamic clouds 



^see IKobbelt and Botsch (2004) for a discussion about 
different available point-based rendering tecliniques 
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Figure 3: The nat ure of astronomical data, demonstrating a mapping between sources of data 
( Brunner et al.l [2002[ ) and data representations (jGallagher ,1995i ). We have selected the most common 
representations of data for each of the sources. 



Table 1: The classification of contributions dedicated to the visualization of large- iV particle simula- 
tions. See Section 12.11 and 12.21 for a description of the visualization techniques and dataset types. The 
methodology column highlights the main implementation trend used in each work. 





Dataset Type 


Methodology 


Visualization Techniques 


AMR 


Scattered 


Structured 


Isosurface 


VR 


Points 


Ostriker and Norman' (|l997|) 


• 






Custom 




• 


• 


[Norman ct a 


1. (1999) 


• 






Custom 




• 


• 


Becciani et c 


d.l (120001 


2001 


); 
); 




• 


• 


Modify 


• 


• 


• 


Gheller et al 


('2OO2I 


2003 


Amati et al. 


(2003) 




Tcubcn ct al. (2001J) 




• 




Modify 






• 


Kahler and Hege 


(120021): 


• 






Modify 




• 




Kahler et al. 


(20021 I2OO3I 


20061) 


Palominol (120031) 






• 


Existing 




• 




Hoof and Ertl 


( 


2003 


); 




• 




Custom 




• 




[Hopf et al.' (2004*) 




IgtaflP ct al. (2004) 






• 


Modify 


• 




• 


[Ahrons ct al 


(2006) 


• 






Modify 


• 


• 


• 


iNavratil ct al. (2007|) 






• 


Existing 


• 




• 


ICahler et al. (2007*) _ 








Custom 




• 




^omparato et al. (2007) 






• 


Modify 


• 


• 


• 


Biddiscombc ct al. (,2007i) 








Modify 






• 


[Linscn ct al. 


(2008") 








Custom 


• 


• 




iPubinski (2008) 








Custom 




• 




[Szalav ct al. (2008) 








Custom 




• 




Dolag ct al. (2008) 








Custom 




• 




jkapfcrcr and Riser (2008*) 






• 


Existing 


• 




• 


l^akasonc ct al. (2009) 








Custom 






• 


|Farr ct al. (S 


009) 








Custom 






• 


Jin et all (12010) 








Custom 




• 




Becciani et al.l (|2010D 






• 


Modify 


• 


• 


• 
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in the interstellar medium, stellar jets from variable 
sources, neutron star - black hole coalesc ence, and 
accretion disks around a black hole. iNavratil et al.l 
(|2007l l used Paraview and Partiview to render a time 
depended datase t of the first stars and their impact on 
cosmic history. iKapferer and Riseil (120081 ) presented 
the usage of IFrIT, MayaVi data visualize, Paraview, 
and VisIT with a discussion of the visual quality as- 
pects, generating interactive 3D movies, real-time vec- 
tor field visualization, and high-resolution display tech- 
niques. They also showed the usage of VisTrials work- 
fiow system for saving visualization meta-data. 

The second approach w as to modify or exte nd ex- 
isting general purpose tools (iBecciani et a l. 2000, 2 0011: 
GheUer et all 20021: Hclhler et all |2002|: iGhcUcr et~aLl 



2003| : lAmati et al.ll2003l:lAhrens et al.l2006l:lBecciani et al.l 



201C ). IBecciani et all (l2000l,l200ll '). lGheller et al.l l|2002l . 
2003), and lAmati et all (|2003i rdescribed the develop- 



ment of the AstroMD tool (a tool developed within 
the European Cosmo. Lab projeclQ). Its user interface 
was built based on TCL/TK while its visualization 
functionality uses VTK. It includes visualization capa- 
bilities such as: isosurfaces, volume rendering, point 
pi cker, and sphere sample r. Thi s work was continued 
bv lComparato et al.l (|2007t ). and lBecciani et al.1 (|2010l ') 
through the VisIVO project. VisIVO was developed 
based on the Mul t imod a pplication framewor k (M AF). 
IMhlcr and Heed l|2002t ). lKahler et ^ (|2002h . and lKahler 



2003. . .2006 ') introduced an AMIRAQ extension to ren- 
der adaptive mesh refinement datasets. Their work 
was initiated within the framework of a television pro- 
duction for the Discovery Channel for rendering for the 
first stars in the universe. 

The final approach is to develop a custom system 
or library from scratch. From Table U we can say it 
is quite a po pular choice llOstriker and Norman||l99^: 
Norman et al. 1999; Kahl er et al.1 1 2007: Lins en et all 



2008; Dubinski 2008; Szalav ot al. 2008; Nakasono et al.' 
2009; ,Jin_et al. 2010). Ostrikcr and Norman (1997), 
and lNorman et al.1 jl999l ') described the work done within 
the Computational Cosmology Observatory (CCO) which 
act as an environment analogous to an astronomical 
observatory. Its implementation included: a special- 
ized I/O library to handle HDF files, a desktop visual- 
ization tool, virtual-reality navigation and animation 
techniques, and Web-based workbenches for handling 
and exploring AMR data. 

iKahler et all (12006!) and iKahler et all (|2007l ) used 
a CPU-assisted ray casting algorithm to provide a high 
quality volume rendering of AMR datasets. They avoided 
re-sampling the point's data onto a structured grid 
by directly enc oding the point dat a in a CPU-octree 
data structure. iLinsen et al.l (|2008l 'l adopted a visual- 
ization approach based on isosurface extraction from 
multi-field particle volume data. They projected the 
TV-dimensional data into 3D star coordinates to help 
the user to select a cluster of features. Based on the 
segmentation property induced by the cluster mem- 
bership, a surfa ce is extracted from the volume data. 
iDubinskil l|2008l ') presented the MYRIAD library . MYR- 



IAD has been integrated with two different parallel N- 
Bo dy codes (P ARTREeB and COTPA©. 

ISzalav etal. (2008) implemented a system that uses 
hierarchical level-of-details (LOD) for particle-like cos- 
mological simulations, in order to display accurate re- 
sults without loading in the full dataset. They were 
able to achieve a framerate of 10 frame per second 
with a desktop workstation and N'Vidia GeForce 8800 
graphics card. 

The last notewo r thy w ork in this direction is that 
done bv lDolag et al.l (|2008l 'l and lJin et al ] (|2010l ). They 
introduced a tool to render directly point-like data in 
the GADGET-2 format. They used ray tracing to ren- 
der in a fast and effective way the different families of 
point-like data. The same algorithm was enhanced to 
use GPUs with CUDA and distributed clusters using 
MPI. 

There is no clear choice as to which approach should 
be favoured, as there is a strong dependence on the vi- 
sualization objectives and target. Most of the users 
of the first and the second trends aim to minimize the 
development cost and to use existing, tested, and open 
source packages with minimal or no modification. On 
the other hand, the researchers using the third ap- 
proach aimed to enable the use of available advanced or 
specialized hardware infrastructure [e.g. the Gr id envi- 
roiuncnt (Bccciani et al. 2010), or GPUs fKahl er" et al.l 
"^tljfl OS) and l|Jin et al.ll201 0)]: produce better or faster 
visualization results th rough customizin g an existing 
visuahzation technique [Hppf et aP (l2004t l ; iDolag et al.l 
(|2008l '): ISzalav et al.1 l|2008D ]: or utilizing new platforms, 
such as the web-platform or virtual environments, and 
provide the users with better user interfaces or sup- 
port coUaborath^inter^^ [Nakasone et al. (200i|) 
and lBecciani et al.l (|2010r i]. 

'Visualization approaches and software have needed 
to keep pace with improvements in simulation tech- 
niques and resolution (which can include an increase 
in or the number of grid cells). Indeed, visual- 
izing "large-A*'" datasets, relative to the era of im- 

plem entation, was ad dressed by most of the wo rks 

Ost riker and Normarilfl 997): No rman etal] ll 19991) :IWelling and Dt 
(i2000ll: IKahler et all (12006. .2007, ) :lsralav et al.1 (|200ai l 
I Jin et al.l (|201G| '): IBecciani et al.l (|201Gl ')]. Attempts to 
solve this problem included the use of Grid-computing 
or a distributed cluster as the computing infrastruc- 
ture (Ostrikcr and Norm an 1997': iNorman et al.lll999l : 
Ijin et al. ,201Q : IBecciani et al.. .20101): using GPUs as 



the computing infrastructure j 



Ahrens et al. 2006; Kahler et al 



Kahler et al.l2007i:iSzalav et al 



12006': 'Bid discombe et a"l]|2007l : 

2008; Jin et al.ll20ld ). and see lHassan et all (|2010l ) for 

a solution using a distributed cluster with GPUs; and 
using the dataset characteristics or optimized data struc- 
ture to provide a multi-resolution vi sualization solu- 
tion (|Hopf and Ertll2003l : iHopf et al.ll2004i '). 

Of all the applications of scientific visualization in 
astronomy that we have examined, A'^-particle data 
provides the closest match to, and hence may be the 
greatest beneficiary of, advances in the wider field of 
scientific visualization. Their particular use of scat- 
tered and grid data formats means that general pur- 



^http:/ /cosmolab. cineca.it/ 
''^http: //www. amira.com/ 



*http: / /www. sdsc.edu/pub/envision/vl5.2/hornquist. html 
^http: / /www.cita.utoronto.ca/ dubinski/gotpm/ 
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pose visualization packages (see Section [S]) are more 
suitable for handling simulation data, notwithstand- 
ing the need to convert from custom astronomy data 
formats to required input formats. There may be some 
benefit in providing simple file conversion tools, oth- 
erwise astronomers using simulation data may care to 
investigate alternative standard data representations 
(e.g. HDF£3, VTK file format). While sharing some 
similarities with gridded simulation data, visualization 
of spectral data cubes presents some unique problems, 
which we now explore. 



2.4 Spectral Data Cubes 

A spectral data cube comprises two spatial dimensions 
(usually RA and Dec, or galactic longitude and lat- 
itude), one frequency or wavelength dimension, and 
a flux value m The frequency or wavelength dimen- 
sion is often converted to a line-of-sight velocity us- 
ing Doppler-shift relationships. Spectral data cubes 
are more common in radio astronomy, however, with 
improvements in integral field units (IFUs) and simi- 
lar instrumentation, optical/IR astronomy is seeing a 
growth in the collection and use of spectral cubes. 

Spectral data cubes are characterized by a lack of 
well defined surfaces, low signal to noise data values 
combined with a high dynamic data range, and the 
use of special coordinate systems that do not always 
match well with the equal-unit 3D spatial coordinates 
of other disciplines. This limits the use of existing gen- 
eral purpose scientific visualization tools, particular in 
comparison to simulation data. It is still very com- 
mon for astronomers to rely on 2D techniques, such 
as data slicing or projected moment maps, as the pri- 
mary method for visualizing data. These approaches 
can be achieved using packag es like SAOIm age DSSQ, 
or some modules of Karma (|Gooch|[l996i ). However, 
with terabyte-scale data cubes from near term facil- 
ities telescopes like ALMA, ASKAP, and MeerKAT, 
slicing techniques may not be feasible (e.g. it would 
take 30 minutes to step through a 16,000-channel 
ASKAP cube at 10 frames/sec, assuming that there 
was software capable of supporting this approach), and 
the complex kinematics of, e.g. an unresolved pair of 
merging galaxies, may not be fully captured using a 
2D moment map. 

Early work b y lNorrii (|l994 ). iGoochl ^5^), and 
lOosterlool l|l995f ) emphasised the opportunity for 3D 
visualization to aid in the processes of data analysis 
and knowledge discovery. Since then, three main tech- 
niques have been used to visualize spectral data cubes: 
isosurfacing, volume rendering, and (2D) data slicing. 
Volume rendering has dominated 3D spectral cube vi- 
sualization in general due to its ability to give the user 
a global data perspective, despite the lack of well de- 
fined surfaces within the observational data, and its 
improved capability of visualizing in the low signal to 
noise regime. 



Table[2]shows the key publications relating to spec- 
tral data cube visualization. Several comments need 
to be made on the table: 

• The data source classification was based on the 
experimental data presented in each paper. 

• The implementation trend "Modify" is used to 
describe the published work if it uses an external 
library or tool to perform/su pport the vi sualiza- 
tion. In some cases [e.g. iBeeson et al 

] llOOS)] 

the application may add a lot of customizations 
and code enhancement to effectively handle the 
astronomical datasets. 

• It is clear that the number of publications in 
this research branch is relatively fewer than the 
publications in A'^-particle visualization. 

• As noted before volume rendering is the key vi- 
sualization technique and is supported by all the 
tools. 

The implementation trends for spectral cube visu- 
alization are similar to those found for particle data: 

• Modify /extend an ex isting general purpose visu- 
alizati o n library [e.g. Domik (1992'): Bmgcl ct al.l 
(IT99l):lPlante et an|r99a l: ,Beeson et al.. (,2003l )7 
iDraoer et al.l (120081 )]. 

• The use of some visualization packages devel- 
oped to serve the medical visualizatio n domain 
such as Paraview, 3D sheer, and Osirix l|Borkin et al.l 
l2007l ). 

• Build a custom vis ualization library /application 
(lGoochiri 996: Ka hler et al.ll2007l : iLi et al]|2008l : 
iHassan et al... 201(3 )^ 

Special attention has been given to vtk[3 as a ba- 
sis for modifications /e xtensions achieved via the first 
imple mentation trend (jPlante et al.lll999l : lDraper et al.l 
I2OO8I '). On the other hand, it is also possible to use 
some of the packages classified as A'^-particle visual- 
ization tools for spectral data. Although no explicit 
examples have been shown through their publications, 
most of the A'^-particle tools capable of handling struc- 



-"^ ''http://www.hdf group.org/HDF5/ 

^^This may be any one of the four Stol^es parameters, but 
is usually Stokes I. 

http : / /hea- www . harvard . edu/RD/ds9/ 1 



tured g rids can visualize sp e ctral data cube s [e.g. GhcUcr et al.l 
(120031') : lAmati et all (|2003l '): lBecciani et all (|2010i l: iKahler et al.l 
(200l]. 

While the usage of high performance computing 
architecture and hardware play an import ant role in vi - 
sualizing A''-particle datasets, onlylBeeson et al.ll|2003l ). 
iLi et al.l (pboa) and lHassan et al.l l|2010l ) use that ap- 
proach to improve the rendering speed or to handle 
larger than memory spectral datasets. 

We believe 3D spectral data cube visualization is 
still in its infancy. There is a need to move spectral 
data cubes visualization tool from "pretty picture" - 
generating tools into powerful data analysis tools. Spec- 
tral data visualization tools should provide their users 
with: quantitative visualization capabilities, ability to 
handle huge datasets exceeding single machine pro- 
cessing capacity, accepted interactivity levels, and ef- 
fective noise suppression techniques. Also, offering 
powerful two-way integration with other data analysis 



^ http : //www . vtk . org/ 1 
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Table 2: The classification of contributions dedicated to the visualization of spectral data cubes. See 
Section ETTI and for a description of the visualization techniques and dataset types. The methodology 
column highlights the main implementation trend used in each work. 





Dataset Type 


Methodology 


Visualization Techniques 


Radio 


IFU 


Isosurface 


VR 


Slicing 


iDomild (1992');'Brugel ct al.' (1991) 






Modify 


• 




• 


iGoochI (T995a. 1996,1: .Oosterlool 
(1995, 199d) 






Custom 








Plante et al.' (1999") 






Modify 








Beeson ct al 


(2003) 






Modify 








Miller et al. 


(2006) 




• 


Existing 








Borkin et al 


( 20051 12OO7I1 






Existing 


• 




• 


Li ct al. (2008) 




• 


Custom 








Draoer ct al 


(2008) 






Modify 


• 






iHassan et al 


i (,2oim 






Custom 









and reduction tools will be key to facilitate the wider 
usage of such tools. We will further discuss these issues 
within Section |4l 

We now turn our attention to other developments 
in scientific visualization that are not based on the 
data representation: distributed and remote visualiza- 
tion services, collaborative visualization, visualization 
workflows, and public outreach outcomes. With the 
exception of public outreach visualization, there has 
been much less research effort expended in these areas 
for astronomy, and consequently, their level of commu- 
nity up-take is somewhat lower than for the particle 
and spectral cube approaches we have examined. 

2.5 Distributed/Remote Visualization 

Desktop computers have a finite memory size, typically 
a few gigabytes, yet many datasets from observation 
and simulation are much larger than this (e.g. pro- 
cessed ASKAP data cubes will be over 1 terabyte). A 
solution to this problem lies in the use of distributed 
visualization, where a networked computing cluster 
shares the processing tasks. 

A typical astronomer does not always have im- 
mediate access to sufficient computational power or 
data storage capacity to deal effectively with such large 
datasets. Moreover, effective and efficient implemen- 
tation of software to deal with large datasets requires a 
higher-level of computing knowledge relating to choice 
and use of appropriate data structures, techniques for 
scheduling, etc. Remote visualization therefore presents 
an opportunity to provide the wider astronomy com- 
munity with a visualization service with potentially 
lower cost, administrative effort, and a reduced need 
to transfer data. At the same time it presents a cost ef- 
fective way to further utilize existing expensive compu- 
tational infrastructure. This philosophy was the main 
motivation for the Virtual Observatory (VO) concept 
of sharing datasets, and providing astronomers with 
dat a analysis and visu alizati on software as a service 
[see | Quinn et al.l l|2004f) , and IWilliams and De Youngj 
l|2009l ) for details]. Rather than requiring local hard- 
ware, a user requests a visualization of a dataset from a 
remote host - the outcome of the visualization, usually 



an image, is returned to the user. Along with the time 
taken to produce images, such a system has an over- 
head in terms of the interaction speed and the network 
speed. 

The issue of providing 3D visualization and com- 

puta tional infrastructure as a servi c e was addr essed by 

Pla nte et all (| 19991 1. 1 Murphv et all (|2006l '). and lBecciani et al.1 
(i2O10i r All of them agreed on using the Web as the 
main service platform. iPlante et al.l (| 19991 ) built a cus- 
tom VRML viewer using JavaSD to render the output 
of a VTK-based server. The custom VRML viewer 
enable them to provide additional interactivity ser- 
vices such as a 3D cursor, the ability to select sub- 
regions, and produce 2D JPEG snapshots of the vi- 
sualizatio n output. Th e same methodology was used 
by Bccso n et all (|2004l 'l to visualize data from cata- 
logue streamed in XML format, but wit h a ready made 
browser plugin to render VRML output. iMurphv et al.l 
(2006) describe an image display remote visualization 
service (RVSj3 through a set of VO tools for the stor- 
age, processing and visualization of Australia Tele- 
scope Compact Array data. The RVS server accepts 
FITS images and provides a 2D visualization using an 
AIPS++ back end. 

The last and probably one of the most co mplete 
systems is VisIVO wel{3 (|Becciani et al.ll2010l '). The 
system uses Web 2.0 technology for user interaction, 
while the output is generated as static images, with 
a semi-interactive control of dataset orientation and 
movie generation. It is a simple way to implement 
such functionality, but is perhaps not as intuitive as 
the interaction provided through custom web controls 
or environments such as Java3D. 

The usage of distributed processing to enable as- 
tronomers to handle larger than me mory data s ets wa s 
add ressed by i Bccson ct all feooil. Ijin et al.1 (|2010h . 

and lHassan et al. (,201Q ) . iBeeson et al.l l|2003|) extended 

the s hear warp volume-rendering algorithm ijLacroute and Levovl 
1 1994] ') with a distributed implementation. Demonstrated 
using both spectral line data cubes and A^-body datasets, 
their technique relies on distributing the volume data 



^^http : //www. atnf . csiro . au/vo/rvs/ 

^° _http : //visivoweb . pact . inaf . it/visivo«eb/lndex .php| 
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among the participating computing nodes and then us- 
ing the associative "over" operator to yield a final im- 
age. Their code was based on Virtual Reality Volume 
Re ndering (yiRVO ) codeQ. 

Ijin et aP (|201(]t ) developed a custom ray tracing 
code to render, in a fast and effective way, point like 
data. They exploit the use o f multi-core architec- 
ture using OpenMP (Dolag et al.l 2008), distributed 
memory architecture using MPI, and CPUs using the 
CUDA development toolkit. Their t echnique was demon - 
strated using TV-body datasets only. iHassan et all (|2010l ) 
used a distributed GPU cluster to enable ray-casting 
volume rendering of datasets up to 26 Gbytes at frame 
rates better than 5 frames/sec. Combining shared and 
distributed memory high performance computing ca- 
pabilities enabled them to handle large than memory 
datasets at an ac cepted frame rate wi th a lower num- 
ber of nodes than lBeeson et aD (|2003l ). 

2.6 Collaborative Visualization 

Collaborative visualization enables multiple users to 
share a visualization experience. For this to be suc- 
cessul, the main requirements are high-speed networks 
and effective co mmunication protocols. E arly work in 
this field was bv lVan Buren et all (| 19951 ). who imple- 
mented the AstroVR CoUaboratory environment for 
distributed users to share in the analysis of FITS im- 
ages. Communication between users was via audio, 
video, or typed text. The AstroVR approach was 
motivated b y early clie n t-se rver, multi-user networked 
game £3. Planteetal described collaborative 

support in the NCSA Horizon Image Data Browser 
(Version 2.0) via NCSA HabanercQ- CoUaborators 
were able to join a hablet session following an e-mail 
invitation, with interaction via the GUI visible to all 

participa nts. 

Bo th iDiorgovski et aP (|2009 h and 'Nakas one et al.l 
(12009) consider the use of virtual environments based 



on the Second Lif£3 framework developed by Lin- 
den Labs. Launched in 2003, Second Life is an on- 
line, multi-user, virtual world application with sup- 
port for real-time interaction, creation and exploration 
of three-dimensional environments, and synchronous 
communication (including both text and voice). As 
of early 2010, Second Life had more than 16 million 
registered accounts, although ~ 40, 000 "residents" are 
typically online at any one time. It is the collaborative 
experience that is of most interest to astronomers - ge- 
ographically distributed users can interact simultane- 
ously with a data visualization, with feedback on what 
the other participants are doing/seeing. The main 
drawback at present is the limited support for large 
astronomical datasets: the Second Life application im- 
poses a limit of 15,000 objects, leaving [Nakasone et al.l 
(|2009l ) to experiment with visualizin g only 1024 parti- 
cles from a stellar cluster simulatio n. Diorgovski et al.l 



((2009. ') propose adapting OpenSirrl''°l. an open source 



^^http : //www. calit2 .net/- jschulze/projects/vox/releas( 

^'Also known as Multi-User Dungeons or MUDs. 
^*^http : //www. isrl . illinois . edu/isaac/Habanero/ 1 
^^http : //secondlif e . com 



^ http : //opensimulator . org| 



implementation of Second Life, which may partly re- 
move that restriction. 



2.7 Image Display and Interaction 

While not unique to scientific visualization, the use 
of advanced displays for presentation of, and inter- 
action with, three-dimensional datasets is worthy of 
consideration. Advanced displays may include tiled 
or multi-display walls, stereoscopic environments rang- 
ing from flat-screens to immersive CAVE-like environ- 
ments, and domes (upright and tilted). 

Early descriptions of the limitations of 2D displays 
for 3D astr o nomical dat a are in Fomalon t (1982) and 
iRotd (|l986f l. iRotsI (|l986l 'l described the use of a mosaic 
of 2D slices, time-sequence animations, the creation of 
3D solid surfaces (ie. an isosurface at a given thresh- 
old level), and the possibilities offered by stereoscopic 
images and holograms! Fluke et al. (2006) considered 
a suite of advanced displays including multi-panel or 
tiled displays, digital domes, and stereoscopic projec- 
tion, with descriptions of low-cost implementations of 
each display. Comprehensive overviews of stereoscopic 
an d 3D display syste ms and technologie s may be found 
in lMcAllisteJ (12006') or HoU iman et all (120061 ). 

One of the main challenges is the lack of native sup- 
port for advanced displays from visualization software 
(jFluke et al.l 120061 ). Most advanced displays require 
images in a different format to conventional displays 
(i.e. on a monitor or data projector). This includes 
fish-eye or other spherical projection for domes, and 
image pairs for stereoscopic displays. There is an over- 
head in producing such frames, which can have a neg- 
ative impact on frame rates and hence usability. On 
the other hand, viewing data with an advanced dis- 
play may yield additional insight. Apart from a few 
projects using CAVE-like environments, stereoscopic 
and dome display has mostly been reserved for public 
outreach visualization (see Section [2. 9|l . 

A related issue, which has yet to achieve a sat- 
isfactory resolution, is the choice of appropriate 3D 
interaction device. Intuitive and easy real-time inter- 
action with visualization output, including changing 
visualization parameters, cam era position, and in ter- 
active dynamic data filtering (|ShneidermarJ IT9941 ) . is 
vital to achieve the required visualization outcomes. 
This may also be one of the reasons why qu antitative 
techniques in 3D have not advanced (|Gooch : 1995b a), 
as they rely on a device (e.g. for selection of objects 
or regions) that is as simple to use in 3D as the mouse 
is for interacting with 2D data. 

Few astronomy publications have explictly addressed 
practi cal alternatives for interacting with astronomical 
data. iGoochI l|l995bt ) considered the 6-degree of free- 
dom Spaceball (Spatial Systems, Inc.) as an alterna- 
tive to manipulate a 3D cursor within a 3D volume. 
The Spaceball was a low-cost version of the devices 

r7tf^i^vS^™Wt?Yi't" environments, contro lling additional 
"luiiCLiOiiaiiL y SuCii as interactive slicing. iKahler and Hegg 
(|2002l ). and lKahler et all (|2002l ') used a voice and ges- 
ture controlled CAVE application to define a camera 
path following the interesting features. 
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2.8 Workflow 

When dealing with a large amount of datasets, addi- 
tional benefits may be achieved using workflow driven 
applications. Selecting a certain visualization parame- 
ter is not usually a straight forward process: knowledge 
about the visualization algorithms, and the dataset 
characteristics are essential to achieve sensible visual- 
ization outcomes. Indeed, reproducing specific visual- 
ization results is challenging, particular when an inter- 
active process has been used to control properties such 
as data limits, transparency, colour maps and orienta- 
tion. Keeping metadata about the visualization pro- 
cess itself through an integ rated workflow managemen t 
system was addressed by iKapferer and Riser! (|2008f l . 
They discussed the usage of VisTrialH as a scientific 
workflow management system that provides support 
for data exploration and visualization. 

On the other hand, providing the user with visu- 
alization software that tightly integrates with simula- 
tion, data analysis, or data generation tools may facil- 
itate the use of new visualization tools/techniques, re- 
move the data conversion barrier, and provid e a better 
intero p erability. Some published work [e.g. iDubinskH 
(|2008l '): IComparato et al.l l|2007l )] discusses this con- 
cept, and different real time data sharing and inte- 
gration proto cols were introduced as a part of the VO 
init iative [e. g lTavlor et al.1 l|2006D ]. 

iLi et al.l (|2008l ') presents a visualization workflow 
for multi-wavelength astronomical data. The impor- 
tance of their work comes from the completeness of 
their proposed framework that included GPU-based 
data processing and new ways to visualize multi- wavelength 
astronomical data with volume visualizations (such as 
the "horseshore" model) . They offer a collection of in- 
teractive exploration tools tailored for multi-wavelength 
datasets. 

2.9 Public Outreach 

Astronomy has a demonstrated history of engaging 
public interest in science - this has been achieved in 
large part by the appealing visuals that are routinely 
generated from telescopes and simulations. As a pro- 
fessional astronomer, there is something special about 
being able to share the results of our research work 
with the public. It is easy for our passion to inspire au- 
diences of all ages, from the youngest school students 
to adults. However, the techniques that we often use 
in collecting, understanding and exploring our datasets 
(histograms, scatter plots, error-bars, etc.) do not al- 
ways make for visually appealing, or necessarily un- 
derstandable, presentations. Public outreach visuals 
are qualitative or occasionally comparative, but rarely 
quantitative. 

In some sense, public outreach use of scientific vi- 
sualization techniques has exceeded that for science 
outcomes, with a number of advancements in astron- 
omy visualization motivated by outreach or presen- 
tation goals. At times, the divide between an out- 
reach visualization, and one that is intended to help as- 
tronomers to gain deeper understanding of their mod- 

^^ ^http : //www, vistrails . org/ index .php/MainPagel 



els and observerations, is very narrow. Cases in point 
are the highly realistic r enderings of the Orion nebu- 
lae llEmmart et al.ll200(]|'). emission nebulae, and plan- 
etary nebulae (|Magnor et"aI]l2004^ ■ which we describe 
below, and the pre vious discussion of AMR visualiza- 
tions starting with lKahler et al] (|2002l ') (section |2.3[I . 

In 2000, within the SIGGRAPH 2000 electronic 
theatre, a team from the San Diego Supercomputing 
Center (SDSC) presented a vo lume rendering vide o 
animation for the O rion nebula ( Emmart et al .1120001 ) . 
iNadeau et aP (120011 1 and lGenettil (|2002l ) desc"ribed this 
work in more deta il, includ ing their use of a volume 
scene graph (Nadeaul |2000| ). They reported a set of 
limitation in the available volume rendering applica- 
tions/libraries, including a lack of efficient parallel per- 
spective volume rendering, forcing them to build a cus- 
tomized parallel perspective viewing model, and the 
need for high voxel resolution to capture all details over 
a wide range of length scales (from proplyds within 
the central region of the nebula, with a scale of 0.007 
light years, to the outskirts of the nebula at 14.3 light 
years). Additionally, to achieve a sufficient level of 
photorealism with regards to the glowing gas in the 
nebula, existing treatment of transparency as the in- 
verse of the opacity did not work - it was necessary 
to modify the modelling and rendering tools to allow 
independent values for transparency and opacity. 

Realistic planetary nebula models were created us- 
ing constrained inverse volume rendering bv lMagnor et al.l 
(^OOi). As a purely emissive model (i.e. glowing gas), 
the fast, t exture-based volume rendering technqiue of 
I Cabral et al. (1994) was found to be an appropriate vi- 
sualization solution. The goal of this work was to cre- 
ate realistic looking planetary nebula, enabling mod- 
els to be fit ted to three observed systems with bipolar 
symmetry. iMaenor et al.l |200^ implemented a solu- 
tion to the more complex case of generating interactive 
volume renderings of 3D models with dust (e.g. reflec- 
tion nebulae) by using GPU-based ray-casting. A scat- 
tering depth is assigned to each voxel of the nebulae, 
and these are accumulated along the view-dependent 
line-of-sight. The code was able to handle multiple il- 
luminating stars along with multiple scattering events. 

Computer techniques have greatly simplified the 
process of creating custom animations. S tarting with 
segm ents like Where the Galaxies Are (jCeller et al.l 
119921 ) using data from the CfA redshift surveys, the 
"galaxy distribution fiy-through" has become a stan- 
dard way to visualize galaxy redshift survey data. 

Public outreach visualization often requires the com- 
bination of disparate data sets and data types - and 
visualization packages. F or example, the stere oscopic 
movie Cosmic Cookery (jHolliman et al.l |2006|). used 
data from the 2dF Galaxy Redshift Survev ([Colless et al.l 
1200 ll ). large-scale structure from the Millennium sim- 
ulation (jSpringol ct al. 2005), higher-resolution galaxy 
formation simulations, and conceptual animations to 
link between sequences. Packages used for this movie 
included Celestial PartiView, 3dsMax, VolView by 
KitWareE3 and custom rendering software. 



^^http : //www. shatters .net/celestla 

^^ .http : //www.kitware . com/products/volview.html 
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"Solar Journey", implemented in VRML and OpenGL, 
demonstrates components of the solar envirnoment as 
both an interactive envir onment and a short animated 
film (|Hanson et al.ll2002t ). Problems that needed to be 
solved included registration of multispectral datasets, 
texture-mapping of objects from Earth-based images, 
and difficulities with providing a completely accurate 
spatial model when true spatial information on some 
features was limited. 

While opportunities for further public outreach us- 
ing 3D visualization exist, the reality is that produc- 
tions of this nature come at a cost. They are time- 
consuming to produce, which is not necessarily an in- 
centive for researchers who are already time poor. They 
usually require access to (sometimes expensive) com- 
mercial animation packages (e.g. Maya, Lightwave, 
SDSMax) and experienced animators, both of which 
rarely can be justified within research-only budgets. 
These same animation packages are not designed for 
the types of data that astronomers use, so there a need 
for significant conversions of datasets to animation- 
friendly format (e.g. FITS Liberator). Creating flight- 
paths can be a non-trivial process. Rendering, the pro- 
cess of creating individual frames that are then brought 
together to form a movie sequence, can take from min- 
utes to hours per frame, and can require access to a 
supercomputer or dedicated render farm. 

The challenge is to simplify the process of creating 
engaging visualisations that can also enhance research 
productivity. That is, visualisation tools that are not 
just designed for public presentation, but can also be 
used in the academic context for conference presenta- 
tions, research publications, or department /personal 
web pages. Astronomers usually do not need (or want) 
pre-rendered computer animations to analyze their data 
- real-time, interactive solutions are much more valu- 
able. 



3 Visualization Software 



While astronomers have written about their own vi- 
sualization software, there is no su mmary of the vari- 
ety of packages that are available. iLeech and Jennesi 
(|2005l l surveyed visualization software suitable for sub- 
mm spectral line data, considering user requirements 
such as FITS format, compatability with astronom- 
ical coordinates, support for mosaicking, display of 
2D slices and moment maps, and quantitative capa- 
bilities. 3D rendering functionality was considered "a 
lus" . They weighed u p the pros an d cons of AIPS-I--I- 
McMullin et alfeoo^ l. the Starlink l|Draper et al.ll2005l ') 
Software Collection (speciflcally the kappa and datacube 
packages, which mostly offer vis ualization tasks via the 
command line). Karma [GoochI {1996) - kviz offers 2D 
slicing, while xray is a volume rendering packages], 
OpenD}Q (a general purpose visualization package 
based on IBM's Visual Data Explorer), although data 
conversion to the OpenDX . dx file format was required, 
the PDlE!|Perl module which supports FITS an d NDF 



I2OOOI '). The main conclusion of the comparison was 
that "no single software package met all of the user 
requirements", many tools lacked a GUI, there were 
opportunities for comparing 3D software across wave- 
lengths to avoid re-developement, and o pen-source li- 
censing was desirable. See iPered (|l997D for a related 
comparison of the issues facing astronomers when choos- 
ing between custom astronomical software and com- 
mercial packages for data analysis. 

3.1 Custom code 

While there has been much effort to date in creat- 
ing general purpose visualization tools (such as Par- 
aviewE!!, VisnQ and AMIRAQ), many of these exist- 
ing software packages are not suitable for astronomy 
due to: 

• limitations with handling specific astronomy data 
formats [e.g. FITS or the GADGET-2 file for- 
mat] which require a data format conversion pro- 
cess before using these tools [e.g fits2itlj^ . This 
data format conversion disables the direct real- 
time integration and may imply increase in the 
dataset size; 

• the need for conversion from astronomically mean- 
ingful units (RA, Dec, redshift) to general units 
(cm or mm in three-dimensions), which often 
limits the user to exploring data in a qualitative 

form only [see |http : / /am . iic .harvard . edu/UsingSlicer | 
for an exampleJJ 

• the high-dynamic range low signal-to-noise do- 
main in which many observational projects work; 
and 

• the data volumes (billion particle data generated 
for high-resolution cosmological simulations or 
many giga- voxels for high resolution spectral cubes). 

These issues necessitate the creation of domain-specific 
applications, and solving visualization problems that 
are unique to astronomy. However, utilizing existing 
visualization general purpose libraries is a good start- 
ing point. 

In Table |3] and |4l we provide a list of libraries and 
packages aimed at supporting scientific visualization of 
astronomical data. This list does not make any claims 
on completeness or suitability of apackage for a par- 
ticular dataset. Web links were correct (and live) at 
the time of writing. VTK and OpenGL are the main 
workhorses for scientific visualization, providing the 
basis for many of the listed tools, however, as pro- 
gramming and development environments, they have 
a reasonably steep learning curve, and what may seem 
like simple tasks can take some time to code. The 
advantage of a pre-existing visualization package or li- 
brary (either general purpose or astronomy-focused) 
is that someone else has dealt with implementation is- 
sues, which should mean that you can get to a science 
outcome faster. The down-side is that any pre-existing 



formats, and Python using the PyFITS module IjBarrett 



http : //www . opendx . orgj 
http : //pdl . perl . org 



and B^tittBaA^www. paraview.org/ 

' https : / /wci . llnl . gov/codes/ vlsit/ 1 
*^^http : //www. amira. com/ 
^" http : //am. iic .harvard. edu/FITS-reader I 
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package may not be able to do exactly what you require 
it to do. 
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Table 3: List of the supported visualization techniques for some of the 
most popular visualization packages used in astronomy 



1 djL.Jvcl^fc! 


Rendering 


1 o/^ ri n 1 ^ 1 1 £io 
_LcCliniL[Lieb 




Website 




2D 


3D 






• 


Volume Rendering 
Isosurface 
Label Map 




|http: //www. slicer . org/| 


AIPS++/CASA 


• 




Raster 

2D Contouring 
Vector 


2010 




http : //casa . nrao . edu/ 1 

http : / /www . astron . nl/aips++ ' 


Amira 


• 


• 


Most Volume, Surface, 
Scatter visualization 


2010 


http : / /www . amira . com/ j 


AstroMD 


• 


• 


Scatter Plot 
Isosurface 
Volume Rendering 


2004 


jhttp : // cosmolab . cineca . it/ 1 


DVR 




• 


Volume Rendering 


2004 


Not Available Online 


Glnemo 






3D scatter Plot 
2D contouring 


2009 






http : //www. oamp.fr/dynamique/jc! 


./glnemo 1 












1 


Glnemo2 


• 


• 


3D Scatter Plot 


2010 


http: //bima. astro .umd. edu/nemo/i 


iaii_html/ 


GNUPlot 


• 


• 


Scatter Plot 


2010 


http : //www . gnuplot . info/ 




Hubble in a Bottle 




• 


Volume Rendering 


2007 


http : //hubble . sourcef orge .net/ 


IDL 


• 


• 


Most Volume, Surface, 
Scatter visualization 


2009 




http: //www. ittvis . com/ProductSe] 


'vices/ID 






IFRIT 


• 


• 


Volume Rendering 

Stream Tube 

Isosurface 

2D Contouring 








http : //sites . google . com/site/ if] 


■ithome/| 






Karma 


• 


• 


Raster 

Volume Rendering 
2D Contouring 


2006 






http: //www. atnf . csiro . au/comput: 


.ng/sof tw 




H 


OpenDX 


• 


• 


Most Volume, Surface, 
Scatter visualization 


2007 


http : // www . opendx . org/ index2 . ph] 


Osirix 






Volume Rendering 
IsoSurface 


2010 


jhttp: //www. osirix- viewer . com/| 


Paraview 


• 


• 


Most Volume, Surface, 
Scatter visualization 


2010 


'http : / /www . paraview . org/ 1 


ST cLi L i V ic W 






Scatter Plot 


9nn7 


http : / /www . haydenplanetarium . or] 


;/univers 


RVS 






Raster 

2D Contouring 


2005 




http: //www. atnf . csiro . au/vo/rvs 




S2Plot 


• 


• 


Volume Rendering 
Isosurface 
Vector Map 
2D Contouring 


2009 






http : // astronomy . swin . edu . au/ s2] 


ilot/inde. 






SPLASH 




• 


Volume Rendering 
Vector Plot 
2D contouring 


2010 






http: //users .monash. edu. au/~dpr 


.ce/splas 






StarSplatter 




• 


Scatter Plot 


2007 


|http: //www.psc . edu/Packages/Stai 


■Splatter 


TIPSY 




• 


Scatter Plot 
2D contouring 


2009 








http : / /hpcc . astro . Washington . ed\ 


i/tools/t 






















Scatter Plot 
Line/Spherical Plot 








TopCat 


• 


• 


2010 




http: //www. stcir .bris . ac.uk/~mbt 


'topcat/| 






VisIVO 




• 


Scatter Plot 
Isosurface 
Volume Rendering 
2D Contouring 


2010 






http: //visivo . oact . inaf . it/inde: 


:.phpj 


VOPlot3D 


• 


• 


Scatter Plot 
Surface Plot 
Histogram 


2009 




http: //vo . iucaa. ernet . in/~ voi/V 


)Plot3D_U 
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Table 4: List of the supported data representation for some of the most 
popular visualization packages used in astronomy 



Package 


Data Representation 


Point-Like 


Structured Grid 


3D Cube 


Images 


Catalogues 


3D Slicer 




• 


• 


• 




AIPS++/CASA 








• 




Amira 


• 


• 


• 


• 


• 


AstroMD 


• 


• 




• 


• 


DVR 




• 


• 






Glnemo 


• 










Glnemo2 


• 










GNUPlot 


• 










Hubble in a Bottle 


• 








• 


IDL 


• 


• 


• 


• 


• 


IFRIT 


• 


• 


• 




• 


Karma 




• 




• 




OpenDX 




• 




• 


• 


Osirix 




• 








Paravicw 




• 




• 


• 


PartiViow 








• 




RVS 








• 




S2Plot 




• 




• 


• 


SPLASH 




• 








StarSplatter 












TIPSY 












TopCat 










• 


VisIVO 




• 


• 




• 


VOPlotSD 










• 
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4 Discussion 

In this review of scientific visualization in astronomy, 
we have attempted to provide an overview of the work 
that has been undertaken over the last two decades. A 
few key techniques from the broader discipline of scien- 
tific visualization have been adopted by astronomers, 
most notably the use of volume rendering and scat- 
tered point representations, while others are rarely used 
(in particular, streamlines and vector visualization). 
Based on our assessment of the literature, we now 
consider some of the key challenges for wider adop- 
tion and research into relevant scientific visualization 
techniques for astronomy from the viewpoints of visu- 
alization researchers and astronomers. 

4.1 Challenges for Visualization Re- 
searchers 

Although the format of astronomy datasets may be 
familiar to people working in scientific visualization, 
astrophysical datasets have a set of special character- 
istics that may limit the usability of some more general 
visualization techniques despite them having a much 
wider user-base and higher level of technical support. 
These features can be summarized into the following 
points: 

1. Lack of dominant efficient data representation. 
Within some astronomy sub-fields, there is no 
single dominant data representation. For exam- 
ple, A'^-body simulation data can exists in differ- 
ent data formats such as the Gadget-2 file for- 
mat, and custom ASCII or binary formats. Also, 
there is a lack of standard data representation 
for catalogues. Although the introduction of the 
VOTable format (proposed by the International 
Virtual Observatory Alliance) represents an at- 
tempt to unify data in Internet-accessible for- 
mat, it is not yet widely used. Not only does this 
raise interoperability issues but also makes the 
development of a generic astronomy visualiza- 
tion packages either complex or incomplete. On 
the other hand, some current commonly-used as- 
tronomy data representations (especially FITS) 
are more oriented toward data archiving rather 
than efficient data accessibility. This limits the 
application's ability (not only visualization ap- 
plications) to provide users with fast data load- 
ing, disables the usage of out-of-core algorithms, 
and disables the usage of distributed data stor- 
age. An exception to this is the usage of NCSA 
hierarchical data form (HDPj^ which permits 
para llel I/O and enables distrib uted data stor- 
age (jOstriker and NorniMilll997l '). 
Different packages solve this problem by using a 
single data format for its internal implementa- 
tion and provide users with an importing func- 
tionality that converts existing commonly-used 
data formats i nto the internal file f ormat [e.g 
ISanchez'('2004'):'Sanchcz et al.' ('20041) : [Kissler-Patig 
l2P04); Becciani et_aL (2010)]. This may not be 



an efficient solution for large datasets due to its 
storage and processing requirements. 

2. Low signal to noise ratio and high dynamic range. 
Data generated from radio/optical telescopes of- 
ten combines a low signal to noise ratio with a 
large dynamic range. This requires special data 
manipulation and interpolation schemas, which 
may reduce its effect on the final resultant visual 
output. 

3. Use dimensions in a different way. Most of the 
current visualization algorithms and applications 
are designed to visualize data assigned to 2D/3D 
spatial grids (e.g. CFD and medical grids). Grids 
(if they exist) in astrophysical datasets may con- 
tain different dimension types (i.e: redshift) in 
combination with the regular spatial domains. 
In some cases the dimensional information is 
mentioned as a type of metadata, so the visual- 
ization algorithm must first make a correct map- 
ping between the data axes and the data values 
to be capable to use current known visualization 
algorithms. This also limits the usage of general 
purpose visualization packages in a quantitative 
manner. 

4. Huge datasets: As noted in the previous sec- 
tion, data volumes from large- A'' particle simu- 
lations and high-resolution spectral data cubes 
routinely exceed millions (and often billions) of 
data points. These present problems relating 
to the memory and computational demands to 
handle such data sizes; the need to support high 
levels of interactivity, such as shifting quickly 
through different spatial scales (Brunner et al. 
2002); or streaming of such data volumes. 

4.2 Challenges for Astronomers 

Scientific data visualization can, and does, provide op- 
portunities to support a wide range of existing and 
planned astronomy research projects. Through our in- 
vestigation of the literature, we have determined the 
following reasons why scientific visualization techniques 
may not have achieved a more widespread usage in as- 
tronomy: 

1. The lack of quantitative tools that integrate seam- 
lessly wi th visua l izatio n. This issue was iden- 
tified by iNorrid (|l994l ) , but little progress has 
been made to address it. Using annotations and 
providing the user with quantitative information 
about their data, combined with the qualita- 
tive visualization output, is an essential add-on 
to facilitate the data analysis and exploration 
task. Only a few of the published astronomy vi- 
sualization works show the need for interactive 
and quantitative visualization and provide a pro- 
posed solution for th at [e.g. Amati ct al. ( 2003. ), 
lAhrens et aP (|2006D . and lLi et al.l (120081 )]. 



'' -|http : //www . hdf group ■ org | 



g^]| 2. Visualization is not science for the astronomers. 
The success of an astronomical project is judged 
by the science result it produces. The time in- 
vested by an astronomer in becoming an ex- 
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pert in using or developing visualization soft- 
ware must be balanced against the expected sci- 
entific gain, ft is difficult to justify and ob- 
tain funding based purely on methodological ap- 
proaches such as visualization and data min- 
ing, even if such an approach will demonstrably 
impr ove the scientific return (|Ball and Brunnen 
l200 i^) . We think that this may be the main rea- 
son why most of the astronomy visualization tri- 
als neither lasted for a long period nor resulted 
in a widely used application. 

3. Visualization does not do the science. The suc- 
cessful interpretation of visualization result is up 
to the scientist. The output may not represent 
a straightforward relationship or pattern. Visu- 
alization researchers aim to simplify this inter- 
pretation step, but adding a meaning to the fi- 
nal visualization output is still the astronomer's 
task. 

4. Adjustable parameters and technique configura- 
tion. Selecting a suitable iso-value, a colour 
map, or a transfer function is not always directly 
related to the dataset type or format. Some- 
times this may require a deep understanding of 
both the data and the visualization technique. 
The focus of many projects was to visualize a 
certain object or was with a limited objective. 
Only a small number of projects were target- 
ing general datasets or c ommunity usag e of th e 
software produced [e.g. iBecciani et al.l ll2000l) . 
iBarnes et all (|2006l '). and lBecciani et all (|2010l ')]. 

5. Usability and interoperability. Only the appli- 
cations with focused visualization functionality, 
easy to use user interfaces, easy to deploy in- 
structions, and dedication to a certain data type 
were widely used by the astronomical society. 
Also being a cross platform application is an im- 
portant consideration for usability. 

6. There is a problem in citing the astronomy vi- 
sualization effort or application. In preparing 
this review, we found it very difficult to deter- 
mine an approximate number of users for each 
package. Quite often, astronomy-focused visu- 
alization software is not supported by an obvi- 
ous, citable research paper, so there is a missed 
opportunity for developers to receive tangible 
credit for software that is being used to help 
support research. In some cases, we suspect that 
the lack of on-going development or support for 
some applications may be tied to what is slowly 
being recognized as a wi der issue for softw are 
developers in astronomy (|Weiner et al.l [20091 ). 

7. Where do scientific visualization papers get pub- 
lished? The papers contributing to our review 
come from a range of astronomy journals, confer- 
ence proceedings, and non-astronomy journals. 
The full selection of papers does not appear in 
ADS searching, meaning that astronomers may 
not be aware of their existence - particularly if 
the trend of not citing visualization papers con- 
tinues. Our work serves a purpose in highlight- 



ing some of the more important and relevant pa- 
pers in the field. 

4.3 Six Grand Challenges for the Petas- 
cale Astronomy Era 

We assert that visualization has a critical role to play 
in maximizing the scientific return of astronomical data 
in the Petascale Astronomy Era. However, to achieve 
this goal, work is required to overcome the following 
challenges: 

1. Support Quantitative Visualization. 

To advance astronomy visualization tools from 
"pretty picture" generating tools into effective 
knowledge discovery tools, astronomers need in- 
tegrated quantitative support in addition to the 
currently provided qualitative output. Although 
the current qualitative data views are vital to 
give astronomers global pictures of their data, 
and have the potential to play an increased role 
in quality control of data (see below), there is 
a need to extend astronomy visualization tools 
to better support "doing" science. The abil- 
ity to apply different data filters, inspect data 
points/objects for certain properties, overlay ex- 
ternal catalogues/maps, apply mathematical op- 
erations, and select different sub-regions for fur- 
ther study are examples of missing tools. Most 
of these tools exist in current two-dimensional 
data analysis and processing packages (such as 
Karma) but these offer limited support for three- 
dimensional data. 

Although providing such tools may seem easy, 
large data sizes and low signal-to-noise proper- 
ties will be a limitation for any effective imple- 
mentation. Also, interaction with three-dimensional 
data will need a major change to enable effec- 
tive implementation of such functionality (see 
below). 

2. Effective Handling of Large Data Sizes. 
Handling petabyte datasets will be a big chal- 
lenge for most astronomical data analysis pack- 
ages. Real-time (or near real-time) interaction 
requirements worsen the situation for astronomy 
visualization. Additionally, storage requirements, 
networking costs, and transfer speeds will force 
many astronomers to change their way of doing 
science. 

While most of the development effort now is 
going towards automated data analysis and in- 
formation extraction systems, it is noteworthy 
that: 

• There is no automated system that reaches 
a fOO% recognition rate. Specifically with 
the low signal-to-noise data that is regu- 
larly used for knowledge discovery, it is 
computationally challenging to achieve a 
high rate of automated pattern recogni- 
tion. 

• Scientific visualization is expected to play 
an important role as a quality control tool 
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for the output from different automated 
tools and data reduction processes. Keep- 
ing all the raw data for some new astron- 
omy instruments (e.g ASKAP and MWA) 
will not be feasible, so the trend will be to 
overwrite this data after the data reduction 
process is done. In such cases, the usage 
of scientific data visualization will be vital 
to detect and overcome any defect in the 
data gathering and early analysis process. 

lHassanetlj](|2010D addressed some of these is- 
sues and provided a solution for visualizing larger- 
than-memory datasets with the aid of distributed 
processing and GPUs. However, improving data 
formats to support distributed storage and par- 
allel file accessing, extending current data anal- 
ysis tools to deal effectively with larger-than- 
memory datasets, and extending/enhancing cur- 
rent data analysis tools with techniques more 
suitable to 3D datasets are still missing steps in 
the astronomical data processing pipeline. 

3. Discovery m Low Signal-to-noise data. 

Effectively dealing with noise is an important as- 
pect when dealing with astronomy data. With 
large data sizes, the low signal to noise prop- 
erties of astronomy datasets limit the usage of 
multi-resolution techniques and out of core method- 
ologies. On the other hand, new discoveries usu- 
ally happen near the noise level. Here, visualiza- 
tion plays a vital role in the absence of effective 
automated tools. Although noise suppression 
and removal is a signal processing problem and 
may fall outside the scope of scientific visualiza- 
tion, advanced usage of colors to enhance com- 
prehension and the development of customized 
transfer functions and shaders should be a pri- 
ority for the next generation of astronomy visu- 
alization tools. 

The use of colors in order to enhance compre- 
hension has received little attenti on in astron- 
omy. With t he notable exception of lRector et al.l 
(|2005l . 120071 ) there has been little work in in- 
vestigating whether an application of colour sci- 
ence and visual grammar (such as composition, 
orientation, etc.) can improve cognition. This 
should include a detailed investigation of the 
benefits and limitations of using different colour 
maps and co lour contrasts [suc h as h armonic 
colourmaps - IWang and Mueller! (|2008l )] . Some 
effort has been made in the use of colour in- 
formation to produce photorealistic rendering of 
simulation d ata, such as in the AMR work on 
first stars bv lKahler et al.l (|2006l ') . however, this 
is mostly with a public outreach product in mind. 
In the case of spectral data from a radio tele- 
scope, there is no such property as "photoreal- 
ism" , and a pseudo colour map must be used for 
intensity or fractional polarization. 
Also, the use of transfer functions (or color map- 
ping schemas) to provide astronomers with bet- 
ter insight into their data and suppressing noise 
will boost the effectiveness of visualization us- 



age as a qualit ative data analyses technique [see 
(|Gooch|[l995bl lal) for customized transfer func- 
tions developed for radio astronomy] . There does 
not seem to have been any systematic investi- 
gation of the use of shaders in astronomy vi- 
sualization, yet in other application domains, 
this is one of the main areas o f research inter- 
est [seeJSato ct al. (1998, 2000), Li et all |2003i ), 
and lCorrea and Mai l|2008f ) for example]. 

4. Better Human- Computer Interaction and Ubiq- 
uitous computing. 

The standard computer mouse is well-suited for 
interaction with two-dimensional data, but is 
limited when moving to multi-dimensional data. 
Immersive VR environments provide alternative 
interaction, often through a "wand" , which gives 
the user better control of navigation in a three- 
dimensional world, but this can require an ex- 
pensive infrastructure or increased computational 
resources to drive. We believe that using rel- 
atively cheaper game controllers (e.g the Nin- 
tendo Wii controller), or programmable hand- 
held interaction devices (specifically the Apple 
iPad) as tool for exploration and navigation within 
advanced visualization environments, will be a 
better and affordable alternative. Such low cost 
and easy-to-use solutions may help to bring ad- 
vanced interaction to the astronomer's desktop. 
Also, using ubiquitous computing methodologies 
to make interaction with visualization output 
more accessible and easier for astronomers may 
increase the adoption of 3D visualization [see 
iGreenskv et al.l (|2008l ) for example of using such 
techniques in other scientific domains]. 

5. Better Workflow Integration. 

Improved integration between different data anal- 
ysis and visualization tools will encourage the 
usage of scientific visualization. A typical ex- 
ample is providing two-way interaction between 
source finders and 3D visualization tools, where 
the output of the source finder is overlaid on 
the visualization output, synthesis between data 
analysis/processing and visualization applications 
will provide the user with better control over, 
and give more insight into, the data analysis pro- 
cesses, and potentially speed up the knowledge 
discovery process. 

Seamless astronom^FI. a concept advocated by 
Alyssa Goodman and colleagues, is an exam- 
ple whi ch takes workfiow issues one step fur- 
ther [see lGoodmanI l|2009l ') for a discussion on the 
role of 'modular craftmanship' in data visualiza- 
tion]. Here, complete integration between differ- 
ent areas of the typical astronomer's workflow, 
such as linking searches for astronomical objects 
with related research papers, are all wrapped up 
within an interactive desktop environment. This 
is an extension of a service-oriented computing 
paradigm for astronomers, where the connectiv- 
ity between applications is more natural. While 



^ ^http : //research-microsoft . com/en-us/events/ers3mposlum2009/s 
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early experimentation has centred on the World- 
Wide Telescop43 application, such an approach 
could incorporate 3D visualization either through 
support of remote visualization services, or cross- 
platform browser-based applications. 

6. Encourage adoption of 3D scientific visualiza- 
tion techniques. 

As we discussed in section 14.21 there has been 
a somewhat limited effort by the astronomical 
community to develop widely-used, general pur- 
pose, visualization tools targeted at astronomi- 
cal data. The lack of financial investment, com- 
pared to other disciplines which are motivated 
by both financial and social outcomes, limits the 
effort towards a complete astronomy visualiza- 
tion product with a suitable high level of docu- 
mentation and support. 

Furthermore, there appears to be a social is- 
sue limiting the usage of current available tools. 
This may be due to the learning curve required 
to master a particular application, or the per- 
ceived low level of scientific return from the amount 
of time invested in using an alternative visual- 
ization technique. The lack of technical support, 
easy-to-use tools, and complete documentation 
contribute to limiting the amount of users ben- 
efits from existing tools. 

We expect that this may change during the next 
decade with the increasing demand for better 
knowledge discovery and data analysis pipelines, 
capable of dealing with the upcoming data avalanche. 
Building national/community facilities will pro- 
vide a solution for that on the short-term. Ex- 
tending the use of remote- visualization and data 
analysis tools through the web-platform will min- 
imize the time and effort required to adopt vi- 
sualization and offers a cost effective solution by 
minimizing the total cost of ownership and re- 
duces the need to transfer upcoming huge datasets. 

5 Conclusion 

We have investigated the state of scientific visualiza- 
tion research as applied to the domain of astronomy. 
As with the overall discipline, the use of computer- 
based scientific visualization in astronomy is still a 
young field. Over the last two decades, the astron- 
omy community has invested substantially in domain- 
specific 2D and 3D visualization tools and techniques. 
For example, "Astronomical Data Analysis Software 

6 Systems" (ADASS) the major international annual 
astronomy software conference, has hosted more than 
30 presentations on astronomy data visualization dur- 
ing this period. However, few research groups have 
concentrated for extended periods of time on improv- 
ing visualization techniques for astronomy, and conse- 
quently, the potential for new visualization approaches 
to improve scientific output in the discipline has not 
been thoroughly explored. 

^ ^jhttp : //www, worldwidetelescope ■ org| 



Scientific visualization is a genuine research tech- 
nique in its own right and is a fundamental, enabling 
technology for knowledge discovery. Great discover- 
ies in astronomy are not always related to the pat- 
terns we already know - it is related to the identi- 
fication of strange phenomena, unexpected relations, 
or unknown patterns. These cannot be achieved with 
an automated tool. There is still much that can be 
learnt about the process of scientific visualization and 
its domain specific application in astronomy. With the 
Petascale Astronomy Era on the horizon, there has 
never been a more pressing need. 
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